Skip to content

chore: bump vllm to 0.11.0 #3422

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 7 commits into from
Oct 12, 2025
Merged

chore: bump vllm to 0.11.0 #3422

merged 7 commits into from
Oct 12, 2025

Conversation

alec-flowers
Copy link
Contributor

@alec-flowers alec-flowers commented Oct 4, 2025 •
edited
Loading

Overview:

vLLM released v0.11.0 today.

Details:

Where should the reviewer start?

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

  • closes GitHub issue: #xxx

Summary by CodeRabbit

  • New Features
    • Upgraded underlying AI runtime components to vLLM 0.11.0 and FlashInfer 0.3.1, bringing performance and stability improvements.
  • Chores
    • Updated dependency references to the latest compatible versions.
  • Style
    • Cleaned up obsolete inline notes and minor formatting adjustments for maintainability.

@alec-flowers
bump vllm to 0.11.0
b9d22aa 
Signed-off-by: alec-flowers <[email protected]>
@alec-flowers alec-flowers requested review from a team as code owners October 4, 2025 00:28
@github-actions github-actions bot added the chore label Oct 4, 2025
@coderabbitai coderabbitai
Copy link
Contributor

coderabbitai bot commented Oct 4, 2025 •
edited
Loading

Walkthrough

Version references for vLLM and FlashInfer were updated to v0.11.0 and v0.3.1 respectively in the VLLM Dockerfile and install script. The install script also removed an inline cherry-pick block, replacing it with a placeholder comment, and made a minor formatting tweak.

Changes

Cohort / File(s) Summary of changes
Container build args version bump
container/Dockerfile.vllm		 Updated ARGs: VLLM_REF v0.10.2 → v0.11.0; FLASHINF_REF v0.3.0 → v0.3.1.
vLLM install script maintenance
container/deps/vllm/install_vllm.sh		 Bumped vLLM to v0.11.0 and FlashInfer to v0.3.1; removed historical cherry-pick block, added placeholder comment; ensured trailing newline in final echo.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Poem

A rabbit taps the Docker clay,
New tags hop in—vLLM’s the way.
FlashInfer blinks to .1, so spry,
Old cherry-picks wave bye-bye.
Scripts align, the burrow clean—
Onward we run, swift and serene. 🐇✨

Pre-merge checks

❌ Failed checks (1 warning)
Check name Status Explanation Resolution
Description Check ⚠️ Warning The pull request description includes the required section headings but leaves the “Details” and “Where should the reviewer start?” sections as empty placeholders without any actual content, so it fails to meet the template requirements for describing the changes and guiding reviewers. Please fill in the “Details” section with a summary of the version bumps and cherry-pick placeholder removal, and specify in “Where should the reviewer start?” which files (for example container/Dockerfile.vllm and container/deps/vllm/install_vllm.sh) should be reviewed first.
✅ Passed checks (2 passed)
Check name Status Explanation
Title Check ✅ Passed The title “chore: bump vllm to 0.11.0” is a concise, single-sentence summary that clearly reflects the primary change in the pull request following conventional commit conventions. It highlights the main update to the vLLM dependency and is specific enough for teammates to understand the intent at a glance.
Docstring Coverage ✅ Passed No functions found in the changes. Docstring coverage check skipped.

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@alec-flowers
fix API change
b72b809 
Signed-off-by: alec-flowers <[email protected]>
PeaBrane
PeaBrane approved these changes Oct 7, 2025
View reviewed changes
Copy link
Contributor

@PeaBrane PeaBrane left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do the kv events still work as normal?

@pull-request-size pull-request-size bot added size/M and removed size/S labels Oct 11, 2025
@alec-flowers
fix CI hang
e31d88e 
Signed-off-by: alec-flowers <[email protected]>
@alec-flowers alec-flowers force-pushed the aflowers/bump-vllm-0.11.0 branch from f800902 to e31d88e Compare October 12, 2025 04:38
@alec-flowers alec-flowers force-pushed the aflowers/bump-vllm-0.11.0 branch from 932b121 to adc525e Compare October 12, 2025 17:23
@alec-flowers
api fix, narrow env var fix
6eeff0d 
Signed-off-by: alec-flowers <[email protected]>
@alec-flowers alec-flowers force-pushed the aflowers/bump-vllm-0.11.0 branch from adc525e to 6eeff0d Compare October 12, 2025 19:58
@alec-flowers alec-flowers merged commit 90dc758 into main Oct 12, 2025
20 of 21 checks passed
@alec-flowers alec-flowers deleted the aflowers/bump-vllm-0.11.0 branch October 12, 2025 21:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PeaBrane PeaBrane PeaBrane approved these changes

Assignees

No one assigned

Labels

chore size/M

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@alec-flowers @PeaBrane